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1 Introduction 

The paper is a continuation of the investigation carried in [TIJ and it deals 
with asymptotic nonparametric estimation of the drift coefficient S in ob- 
served diffusion process {yt)t>o governed by the stochastic differential equa- 
tion 

<lyt = S{:yt)<lt + <lwt, 0<t<T, yo = y , (1.1) 

where {wt)t>o is a scalar standard Wiener process, yo = yis a. initial condition. 

In the paper [TT] we have constructed a non-asymptotic adaptive proce- 
dure for which a sharp non-asymptotic oracle inequality is obtained. This 
oracle inequahty gives a upper bound for a quadratic risk. In this paper we 
analyze asymptotic properties (as T —>■ oo) of the above adaptive procedure 
and state that it is asymptotically efficient. This means that the procedure 
provides the optimal convergence rate and the best constant (the Pinsker 
constant). 

The problem of asymptotic (as T -^ oo) minimax nonparametric es- 
timation of the drift coefficient S in the model (II. ip has been studied in 
a number of papers, see for example, [2]-[in]- So the papers [H], [H] and 
|10j deal with the estimation problem at a fixed point. In [8] and [lO] in 
the case of known smoothness of the function S, efficient procedures were 
constructed which possess the optimal convergence rate and which provide 
the sharp minimax constant in asymptotic risks. Further in |8], a adaptive 
estimation procedure was given when the smoothness of the function S is un- 
known, the procedure provides the optimal convergence rate. Moreover, for 
estimation in £2— norme, in [7] a adaptive sequential estimation procedure 
was constructed. The procedure possesses the optimal convergence rate and 



it is based on the model selection (see, [T] and [1]). 

The sharp asymptotic bounds and efficient estimators for the drift 5* in 
model (11. ip with the known Sobolev smoothness was given in [3| and with 
unknown one in [2] for local weighted £2~losses, where the weight function 
is equal to the squared unknown ergodic density. Note that the weighted 
£2— risk considered in the papers [2]- [3] is restrictive for the following rea- 
sons. The ergodic density being exponentially decreasing, the feasible esti- 
mation is possible on an finite interval which depends on unknown function 
S. Moreover, the weighted £2— risk in these papers is local and the centres 
of vicinities in the local risk should be smoother than the function to be 
estimated. Since in the local risk the vicinity radius tends to zero, it means 
really that the proposed procedure estimates the centre of the vicinity which 
can be estimated with a better convergence rate. So the approach proposed 
in [2]- [3] permets to calculate the sharp asymptotic constant by lossing the 
optimal convergence rate. 

In this paper we consider the global £2— risk and we show how to obtain 
the optimal convergence rate and to reach the Pinsker constant. We prove 
that the constructed in [TT] procedure provides the both above properties. 

The paper is organized as follows. In the next Section we formulate 
the problem and give the definitions of the functional classes and the global 
quadratic risk. In Section 3 the sequential adaptive procedure is constructed. 
The sharp upper bound for the global minimax quadratic risk over all esti- 
mates is given in Section 4 (Th. 4.1). In Section 5 we prove that the lower 
bound of the global risk for the sequential kernel estimate coincides with 
the sharp lower bound, i.e. this estimate is asymptotically efficient. The 



Appendix contains the proofs of auxiliairy results. 



2 Main results. 

Let {Q, JF, {J-'t)t>o, P) be a filtered probability space satisfying the usual con- 
ditions and {wt, J-'t)t>o be a standard Wiener process. 

Suppose that the observed process {yt)t>o is governed by the stochastic 
differential equation (11.11) . where the unknown function S{-) satisfies the 
Lipschitz condition, S G Lipj^{M.), with 

Lip^{R) = \fe C{R) : sup '^^"j"^"^^^^' < L 
[^ x,yeR F y\ 

In this case the equation fll.ip admits a strong solution. We denote by {J-'t)t>o 
the natural filtration of the process {yt)t>o and by E^^ the expectation with 
respect to the distribution law P^ of the process {yt)t>o given the drift S. The 
problem is to estimate the function 5* in C2[a, 6]-risk, for some a < b, b—a > 1, 
i.e. for any estimate 5*^- of 5* based on {yt)o<t<T^ ^^ consider the following 
quadratic risk : 

/■* 

n{ST,S) = EsllS^-Sf, \\Sf = S^ix)dx. (2.1) 

J a 

To obtain a good estimate for the function S it is necessary to impose 
some conditions on the function S which are similar to the periodicity of 
the deterministic signal in the white noise model. One of conditions which 
is sufficient for this purpose is the assumption that the process {yt) in fll.ip 
returns to any vicinity of each point x G [a, b] infinite times. The ergodicity 
of (yt) provides this property. 



Let L > 1. We define the following functional class : 

El = {S e Lip^iR) : sup 15(^)1 <L; y\x\ >L, 

\z\<L 

3 S{x) G C such that -L< S{x) < -l/L} . (2.2) 

It is easy to see that 

u* = sup sup S'^{x) < oo . (2.3) 

x€[a,b] 5eS^ 

Moreover, if S* G S^, then there exists the ergodic density 

j„oo exp{2 Jo ^(2;)dz}d|/ 
(see,e.g., Gihman and Skorohod (1972), Ch.4, 18, Th2). It easy to see that 
this density satisfies the following inequalities 

< q^ := inf inf qgi^x) < sup sup Qsix) := q* < oo , (2.5) 

where b^ = 1 + \a\ + \b\. Let Sq be a known k times differentiable function 
from S^. We define the following functional class 

k 

W^' = {S :S-S,eJ:,n C'^J[a, b]) , J^ H^^^') - 5(^-)f < r} , (2.6) 

j=0 



where r > 0, A; > 1 are some parameters, C^ {[0',b]) is a set of A; times 
differentiable functions / : [a, 6] ^ M such that /''*-'(a) = f^^\b) for all 
< i < A;. 

Note that, we can represent the functional class W'' as the ellipse in 
C2[a,b], i.e. 

oo 

w;: = {s : S-S,eE,n C'^J[a, b]) , J2 ^. ^' < ^} - (2-7) 



where 

2« „b 



^.• 



Here (0j)j>i is the standard trigonometric basis in iZgl'^' ^] (^se the definition 
(4.6) in [TT]) and [a] is the integer part of a number a. 

Remark 2.1. A'^oie i/iai the functional class W^ is an ellipse with the centre 
at Sq. Usually in such kind problems one takes an ellipse with the centre 
Sq = 0. In the model (11.11) we cannot take Sq = as the centre since this 
function does not belong to the space S^^, i.e. the process (11.11) is not ergodic 
for this function. 

In [TT] we constructed an adaptive sequential estimator S^ for which the 
oracle inequality (Theorem 4.2) holds. In this paper we prove that this 
inequality is sharp in the asymptotic sense, i.e. we show that the minimax 
quadratic risk for 5*^ asymptotically equals to the Pinsker constant. 

To formulate our asymptotic results we define the following normalizing 
coefficient 

7(^) = ((l + 2fc)r)V(2^-+^)^-^ ^2.8) 

with 

JiS) = / ^d«. (2.9) 

It is well known that for any S G W'^ the optimal rate is 2"2A;/(2fc+i) ^^ggg^ ^^j. 
example, [7]). In this paper we show that the adaptive estimator S^, defined 
by (4.17) in [TT], is asymptotically efficient. 



Theorem 2.1. The quadratic risk (12.1 1) of the sequential estimator S^ has 
the following asymptotic upper hound 

limsup r2'=/(2'=+i) sup ^4^ < 1 • (2-10) 

Moreover, the following result claims that this upper bound is sharp. 

Theorem 2.2. For any estimator Srp of S measurable with respect to J^^, 

hminf inf T^^/(^^+^) sup ^%r^ > 1 . (2.11) 

T-oo 5^ g^^, 7(5) 

Our approach is based on the truncated sequential procedure proposed in 
[U], [7] and ^U\ for the diffusion model (11.11) . Through this procedure we pass 
to discrete regression model in which we make use of the adaptive procedure 
S^ proposed in [9] for the family {S^ ,a G A), where S^ is a weighted least 
squares estimator with the Pinsker weights. In the next section we describe 
the discrete regression model. 



3 Adaptive procedure 

We remind of that in pQ] we pass by the sequential method to discrete scheme 
at the points 

Xi = a -\ — {b — a) , I < I < n , (3.1) 

with n = 2[(T — l)/2] + 1. At each Xi we use the sequential kernel estimator 

(3.2) 
r, =inf{t>to : jl Q {^) ds > H,} , 
where h = {b — a)/{2n), Q{z) = l^^^^^^y and 

Hi = {T - to){2qT{xi) - el)h 

7 



with 

qrixi) = m&x{q{xi) , e^} and q{xi) = — — / Q ( ' ' j ds . 

Note that r^ < oo a.s., for any S E T,^ and for all 1 < / < ra (see, |H]). 

Moreover, we assume that the parameters to = ^o(^) and e^. satisfy the 
following conditions 

HJ For any T> 32, 

16 < to < T/2 and v^/t^^ < e^ < 1 . 

H2) For any 6 > and u > 0, 

lim T" e'^"^ = . 

T^oo 



H3) 



lim to(T) = 00, lim 6/2^ = 0, lim Terp/tQ{T) = 00 

T^oo T^oo T->oo 



/^From (11. II) . fl3.1l) - fl3.2p we obtain the discrete regression model 

s; = sixi) + . 

The error term Q is represented as the following sum of the approximated 
term Bi and the stochastic term 



'Hi 



where 






/^ .A. " V h 



Moreover, note that for any function 5* G W'^ 

\Bi\ < 2Lh = L{b-a)/n. (3.3) 

It is easy to see that the random variables (^/)i<Kn ^^^ i-i-d. normal M{0, 1). 
Therefore, by putting 

r = Fy = { max Ti < T} and Yi = S* Ip , 

l<l<n 

we obtain on the set F the following regression model 

Y, = Sixi)+Ci, Ci = Bi + aiii, (3.4) 

where 

n ^4 

< — r, r := cr^ . 



' (T - t^){qT{xi) - e|/2)(6 - a) " e^(6 - a) ' 
In Appendix A.l we prove the following result: 

Proposition 3.1. Suppose that the parameters to ond ej, satisfy the condi- 
tions H^)-H3). Then, for any L >1, 



lim sup sup E^lcr^l = 0, 

T^oo 5g2^ l<l<n 

where 



''i = <'i - 



qs{xi){b-a) ■ 

Now we suppose that the parameters k and r of the space W^ in (12. 7p 
are unknown. We describe the adaptive procedure from [TT]. First we fixe 
e > and we define the sieve A^ in the space N x R_|_ : 

A, = {l,...,K}x{ti,...,t^}, (3.5) 



where fc* = [l/-\/e], tj = ie, m = [1/e^] and we take e = 1/lnn. We remind 
of that n = 2[(T - l)/2] + 1 > 30, due to condition HJ. 

For any a = (/?, t) E A^ we define the weight vector A^ = (A„(l), . . . , A„(n))' 

with 

{1 , for 1 < J < jo , 

(3.6) 
(l - (j/^a)^)^ , for Jo<J<n, 

where jo = jo(tt) = ['^a/ M^ + 2)] + 1, 

.„.(^,,„)W-.. and ^ i±^^m^^_m^±2)^ 

For any a G A^, through the weight A^, = (Aq,(1), . . . , AQ,(ra))' we construct 
the weighted least squares estimator 



So. = So + E"=i KU) ^j,n <Pj Ir . 

(3.7) 

0,,n = iib - a)/n) El, iXi - Soix,)) M^i) ■ 



We remind of (see Section 4 in [TT]) that to construct an adaptive proce- 
dure one has to minimize the empiric squared error of estimator (13.71) over the 
weight family {\^ , a E A^} . A difficulty appears since the empiric squared 
error contains a term which depends on unknown function S. We estimate 
this term as follows 



1 " 
5,,n with s^.„ = -5Zo^'0-(a;O 



9 =9^ _(t^^ 

1=1 



For any A G {A^ , a G A^} we define the empiric cost function J„(A) by the 
following way 

n n ^ 

4(A) = E ^'(3)01 -2J2 mhn + l^PnW 

10 



with the penalty term defined as 



PnW 



n 



where |Ap = Yl^-i ^^U) ^^^ ^n = ''^ ^ ^T-i '^'i' ^^ ^^^ 

a = agrmin^g_^^ MK) and S^ = S^. (3.8) 

In [TT] we proved the following non-asymptotic oracle inequality. 

Theorem 3.2. Assume that S & T,^ and S^ is defined in (13.71) . Then, for 
any T > 32, the adaptive estimator (13.81) satisfies the following inequality 

7^(^„ 5) < (1 + D{p)) min 7^(5„, S) + ^^ , (3.9) 

oeylg n 

where 

p = 1/(6 + Inn) and n = 2[{T - l)/2] + 1 . 

Moreover, the functions D{p) and Bj,{p) defined in Theorem 4-2 from 01] / 
are such that linip_,Q D{p) =0 and, for any 6 > , 

lim%M = o. (3.10) 

Our principal goal in this paper is to show that the inequality (13. 9p is 
sharp in asymptotic sense, i.e. it yields inequalities (12.101) and (12.111) . 

4 Upper bound 

4.1 Known smoothness 

We start with the estimation problem (11.11) under the condition that S G W^ 
with known parameters k, r and ^(5*) defined in (12. 8p . In this case we use 

11 



the estimator from family (13.71) 

5 = 4 with a = (A;,t„), t„ = /■„£, (4.1) 

where 

l^ = mi{i >1 : ie> r{S)} , r{S) = r/J{S) 

and e = En = 1/lnn. Note that for sufficiently large T, therefore large 
m = [l/e^] = [In^ n], the parameter a belongs to the set fl3.5p . In this section 
we obtain the upper bound for the empiric squared error of the estimator 
(14.11) . We define the empiric squared error of the estimator S as 

1=1 

where the points (x;)^<;<„ are defined in (13. ip . 

Theorem 4.1. The estimator S satisfies the following asymptotic upper 
bound 

limsup T2^/(2fc+i) sup -^ Es\\S - S\\l Ip < 1 . (4.2) 

Proof. We denote A = A^ and u = uj^. Now we remind of that the sieve 
Fourier coefficients (6*^ „) defined in (13. 7p satisfy on the set V the following 
relation (see [H]) 

^.,n = 0^,n + C„. (4.3) 



with 



and 



b — a 



^3,n = —— XI ('^(^') " Sq{Xj)) (f)j{xi) 



n 

1=1 



n 



^j,n K^^^jJn f— ^j,n ' "j,: 
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where 

ij,n = ^ XI ^iii<PA^i) and (5j.„ = —^ ^ Bi4>j{xi). (4.4) 
The inequahty (13.31) imphes that 

\6^J<L{b~afyn. (4.5) 

On the set F we can represent the empiric squared error as follows 

n 

\\S-S\\l = Y,{^-m?0l+2ib-a)M^ 

n n 

+ 2^(1- A(j)) A(j) ^,,„ <5^. „ + ^ P(j) C^„ , (4.6) 



where 

Note that, for any p > 0, 



1 " 
-=5^(l-A(j))A(j)e,,„e,,.. 



2^(1 - Mj))A(j)^„.5^,„<P$^(1-A(j))^^J,„ +P-^E^'(^')^1 
j=i j=i j=i 

Therefore by (I4l) - (l431) we obtain that 

n 

11^ - 5||^, <(l + p) 5^ (1-A(j))'^;,„ + 2(6 -a)M„ 



By the same way we estimate the last term in the right-hand part as 

+ 1 + p-i ^ ^. 

n 



13 



Therefore on the set F we find that 



\Sn~S\\l<{l + p)%{S) + 2{b-a)M^ 



+ (l + p)A„ + 



L\b-af{p + 2) 



pn 



(4.7) 



where 



us)^±^r.xu)rei^^^±-m 



i=i 



1 " ~ / 

.7 = 1 ^ 



AS) 

^> b-a 



Let us estimate the first term in the right-hand part of (14.71) . Note that the 
bounds (12. 5p imply the corresponding bounds for the function J{S), i.e. 



< L^ < inf J(S) < sup J(S) < ^—^ < oo 



(4.8) 



This imphes directly that 



lim sup 



r{S) 



0. 



(4.9) 



Moreover, from the definition (13. 6p we get that 

E;=iA(j? (A,r(5))V(2^+i)A;2 



lim sup 



'5eSr 



ni/{2fc+i) 



(A; + 1)(2A; + 1) 



0. 



(4.10) 



Taking this into account, in Appendix I A. 2 1 we show that 

limsup sup T^k/{2k+i)%{^ < ^_ ^4^^^) 

To estimate the second term in the right-hand part of inequality (14. 7p we use 
Lemma lA.ll We get 



e.a^Stt^E";.. 



[b — a)n 



i=i 



(6 — a)n 



\\s\\l< 



[b — a)n 
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where the constants a^: and u* are defined in (13.41) and (12.31) . respectively. 

Taking into account that E^M„ = and making use of Proposition 3.1 
from [11] we obtain that 

L 



lE^M^lrl 



lEgMnirA < v^^n^ 



n 



Therefore 



Now we show that 



Jim T2'=/(2fc+i) sup lE^M^lrl =0 



T->oo 



lim T2fc/(2fc+i) g^p lE^A^HO. 



T^oo 



sew,*^ 



First of all, note that, for j > 2, 



{b-af^siL=^^-^^sJ:-yM) 



'J," 



n 



1=1 



(4.12) 



(4.13) 



(6-a)E^s„, + (6-a)E^^^.„, (4.14) 



where 



1 " 



^^ (^f4>j{xi) with 0j-(z) = (6 - a)0j^(2;) - 1 
1=1 



Moreover, 



sup 

Sew'' 



{b-a)EgSn - 



AS) 



b — a 



I. "■ 

< 2^ sup Es 



cr, 



n 



1=1 



sup 

Sew'' 



^^ 1=1 



< (6 — a) sup max E^|cr/| 

Sew'' !<'<" 



q'Ab-a) 



Q^n 



where q'^ = max^<^<j, ^^P^eE l^^l-^)!- Therefore Proposition 13.11 implies 
that 

AS) 



lim T2^/(2fc+i) g^p 

n^oo SeW'^ 



a)EgSn - 7 

— a 



0. 
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To estimate the second term in fl4.14p we make use of Lemma 6.2 from [U]. 
We have 






1 

n 



n n 



1=1 j=i 



< 



n 

n ^-^ 

i=\ 



Y.\\3)<^,{< 



j=i 



< a, (2^'^+^ + 2'^+^ + 1) < 5a, 2 



2fc 



a.s.. 



Thus from (14.101) we obtain fl4.13p . Moreover, we can calculate that 

3cr2 



'J''^ - (6 - a)2 ■ 
Due to Proposition 3.1 from [TT], we obtain that 

E^IAnllr^ ^ ^^^E^^nlr. + J(S)n, 

6 - a ^ g. 

This means that 

lim T2^/(2fe+i) sup E^|AJlpc = 

n— >oo 

Therefore by fl4.13p we get that 



sup J^cj|A„|irc 



lim T^k/(2k+i) g^p |E5lrA„| = 



Hence Theorem 14. 1[ D 



4.2 Unknown smoothness 



In this subsection we prove Theorem 12.11 First of all notice that inequalities 
gSD yield 

inf 7(5) > 0. 



16 



Therefore Theorem 14.11 upper bound (12.31) and Proposition 3.1 from [TT] 
imply that 

hmsupT2^/(2fc+i) g^^p JLe ||5-5f <1. (4.15) 

Let us remind of of that we define the estimator S from the sieve fl3.ll) onto 
all interval [a, b] by the standard method as 

n 

S{x) = ^(a;i)l|„<^.<^j + J2 ^i^i)'^{x,_,<x<x,} > (4-16) 

1=2 

where 1a is the indicator of a set A. Putting g{x) = S{x) — S{x) we find 
that 



\\gr = \\g\\l + 2j2r gix,)iSix,)-Six))dx 
1=1 ^""i-i 

1=1 "^^i-i 

For any < e < 1, we estimate the norm ||^|p as 

M' < (1 + e)Ml + (1 + 6-1) J2 r\s{x,) - S{x)rdx , 



1=1 "^i-i 

This means that, for any 5 G S^, 



n{S, S)<{1 + e)E^||^||^ + (1 + e-i) ^'^^^, "^' . (4.17) 



m? 



We recall that S = S^ with a G ^j. Therefore, Theorem 13. 21 with inequalities 
flilSjl - fHTT]) imply Theorem O D 

5 Lower bound 

In this section we prove Theorem l2.2[ We folow the proof of Theorem 4.2 from 
[T3j. Similarly, we start with the approximation for an indicator function, 

17 



i.e. for any for r/ > 0, we set 

/ ( XL — X \ 

/^(x) = rf^ \ l(|„|<i-^)G' — — dw, (5.1) 

Jm \ V J 

where the kernel V G C°°(M) is a probabihty density on [—1, 1]. It is easy to 

see that / G C°° and for any m>l and any integrable function f{x) 



hm / /(x)/™(x) dx = f{x) dx . 
v^o Jk J_i 



Further, we will make use of the following trigonometric basis {ej,j > 1} in 
A [-1,1] with 

ei(x) = 1/V2, e,(x) = Tr^{7T[j/2]x) , j > 2. (5.2) 

Here Tri{x) = cos(a;) for even / and Tri{x) = sin(x) for odd /. 
Moreover, we denote 

Jo = J(^o) ' Qo = feo ' ^0 = ^*^'^o) ' 

where the function Sq is defined in (12.61) . 

Let us now fixe some arbitrary < £ < 1 and according to ]^2] we put 



h = (i;*)2fe+i N^T-^^ (5.3) 

with 

V* = ^ — - — -— — - — -J—, r and Nrp = In T . 

' (l-5)r22fc+i(A; + l)(2A; + l) ^ 

To construct a parametric family we divide the interval [a, b] by the in- 
tervals [xm — h , Xm + h] with Xm = a + 2hm. The maximal number of such 
intervals is equal to 

M= [{h - a) / {2h)] - I . 
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Onto each interval [xm — h, Xm + h], we approximate any unknown function by 
a trigonometric series with N terms, i.e. for any array z = (-2m,i)i<m<Af ,i<j<Af' 
we set 

M N 

Sz,Ti^) = Soix) + ^Y^ z^,jD^/x) (5.4) 

m=l j=l 

with D^-{x) = ej{vm{x))I^ {vm{x)) and Vm{x) = {x - Xm)/h. 

Now to obtain the bayesian risk we choose a prior distribution on M*^^ 
by making use of the random array 6 = {Om,j)i<m<M ,i<j<n defined as 

where Cm j ^^^ i-i-d- gaussian J\f{0, 1) random variables and the coefficients 



t 



m,j 



^/Thqo{Xra) 

We chose the sequence {y*)i<j<N by thre samle way as in (8.11) in [13], i.e. 

K + E'^f' 



y*j = ^TJ ' - 1 with n^ - — — , 



where 



R* = _^ ^0^ N^k+1 

^ J^{k + l){2k + l) 
and 

M 

In the sequel we make use of the following set 



Sy = { max max |C„ A < InT} . (5.7) 

l<m<M i<j<N '-^ 

Obviously, that for any p > 



lim TPP(S^) =0. (5.8) 
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Note that on the set H^ the uniform norm 



\^e,T ^o\* — sup |og^y(x) >-'o(^)l 

a<x<b 

is bounded 

\Se^T - -^oL < r^fTT Yl \fy*j '■= ^T ■ (5-9) 

\/<lJh ^ V ^ 



Taking into account here that 



hm Jo = Jo (5.10) 



it is easy to deduce that e-p ^ as T ^ oo. 

For any estimator Sj,^ we denote by S^ its projection on W^ , i.e. 
S^ = PT^rk{SJ,). Since W^ is a convex set, we get that 

ii4-5ir> ii^°-^ir. 

Therefore, denoting by fig the distribution of 6 in W^ with d = MN and 
taking into account (15. 9p we can write that 

with 

7^ = sup 7(5) , 

where 

Uj, = {S : 15 — 5*01^ < ej, , S{x) = Sq{x) for x ^ [a,b]} . 
Since function (12. 4p is continuous with respect to S, then 



hm 7t = 7o- (5-11) 



20 



Making use of the distribution fig we introduce the following Bayes risk 

n{Sj.)= [ 7^(5^,5,,^)/ie(d^) 

Now noting that IJS'^IP < r through this risk we can write that 

=up %f> > ^7l(S?) - A^^, (5.12) 

with 

^T = ^('^{s.^^twl:} + ls^)('" + \\Se,Tf) ■ 
Propostions 7.2-7.3 from [13] imply that for any p > 

lim T^ Wj. = . 

Let us consider the first term in the right-hand side of (15.121) . To obtain 
a lower bound for this term we use the £2 [a, &]-orthonormal function family 
i^m,j)i<m<M,i<j<N w^ich is defined as 

We denote by X^j and Xjnji^) the Fourier coefficients for the functions 5"° 
and 5"^, respectively, i.e. 



K,j= S^ix)e^/x)dx and X^.{z)= S^{x)e^j{x)dx . 

J a J a 

Now it is easy to see that 

M N 
m=l j=l 

Let us introduce the folowing £^ — * M functional 

S(/)= f e]{v)f{v)dv 



-1 
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Therefore from definition (15.41) we obtain that 

d 



"ViW = ^^jiQ 



m,3 

Now Lemma [A. 21 implies that 

M N -2 






where 



E^ f D^ .iyt)dt 



(rp\ XT' ^O'T ''0 mj^''-' 



In Appendix we show that 



hm max max k^,(r) = 0. (5-14) 

r^oo l<m<M l<j<N '■' 

Therefore taking this into account in inequahty fl5.13p we obtain that for 
sufficiently large T and for arbitrary z/ > 

N 



J, 

where 



rAv,y> = — 



By making use of limit equality (8.9) from [13] we obtain that for sufficiently 
small rj and sufficientUy large T 



1 Jn ^ y- 



^^^ - (1 + z/)2 2Th^ y* + l' 
where Jq is defined in (15.71) . Thus making use of (I5.10p this implies that 
liminfinf ^«^7^(5'y) > (1 - e:)^^:^ 7o . 



T^oo 5j, 
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Taking into account this inequelity in (15.121) and limit equality fIS.llI) we 
obtain that for any < £ < 1 

2k TZ(Srp, S) 1 

liminimi T2k+i sup — > (l-ejafc+i. 

T^oo Sj, s^^k 7(6) 

Taking here limit as e — ;> implies Theorem I2.2[ D 



A Appendix 



A.l Proof of Proposition 13.1 



We use all notations from [TT] . For any function ?/) : M ^ M such that 



+00 



sup \4'iy)\ < oo and / \^lj{y)\dy < c* < oo (A.l) 



we set 



MsW = / ^{y)qs{y)dy and Aj,{^) = ^ / (V^(t/t)-Ms(^)) dt , 



+00 ^ i-T 



In [12] (see Theorem 3.2) we show that, for any u > and for any ip satisfying 
( lA.ip . there exists 7 = 7(0*, L) > such that the following inequality holds 



,,2 



sup PsH^tWI > J^) < 8 6-""" . (A.2) 



We shall apply this inequality to the function 

i^hAy) = TQ 



h^ \ h 
for which f°° ■?/^^^(t/)dt/ = 2. Note now that 



2q{xk) - Ms{^P,,,) = ^ A,„(^,,,) . (A.3) 
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Moreover, 

where g* is defined in (12 .Sp . Therefore we get that 

PsiQi^k) < er) = P5 f ^ y A,kiyt) dt < 2e^J 

Note that for e^. < q^:/2 the inequahty flA.2p implies the following exponen- 
tielle upper bound 

Ps{q{xk) < e^) < 8e-^'**°. (A.4) 

Now we show that 

hm sup sup — Eg Iq^ixi) — Qsi^i)] = 0. (A. 5) 

T-'Oo !<;<„ sgs^ ^T 

To end this we have to prove that 

hm sup sup -E^ \q{xi) - M5(^^^,)/2| = 0. (A.6) 

T^oo !<;<„ seSj^ ^T 



Indeed, from ([Qjl -dXaD we find 



E5 \Qixi) - M^(^,^J/2| = ^=Es\A,^{^,^,)\ 



1 



V'^0 Jo 



< A r e-^^^ d^ . 



The condition H^) imphes that ^tV^ — i> 00 as T ^ 00. Therefore this 
inequahty imphes (]A.6p . Moreover, taking into account that h/ej, — > as 
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T — ^ oo we obtain, for sufficiently large T, the following bound 
l^sii^h^df^ - (lsi^i)\ < J ksi^i + ^h) - qsixi)\dv 

where q^ = supi^i^^sup^^^ |g^(a;)|. /^From this inequality, taking into ac- 
count inequality flA.6p and the condition Hg), we obtain flA.Sp . 

Since T — 2 < n < T, we find that, for sufficiently large T providing 



Ct < 1) 



E. 



cr, - 



(lsi.xi)ip - a) 



I ^s 

h- a ■^ 



2n 



{T-t,){2~q{xi)-e^ 



< 2E l^l^'J ~ (JsK^in ^ e 



T' 
T 



Qsi^i) 



(^T<l*ib-a) q*{b-a) 



+ 



+ 



2tr 



(T - to)er^{b -a) (T - to)erp{b - a) 
The condition Hg) and (lA.Sp imply directly Proposition 13.11 D 



A. 2 Proof of the limiting inequality ( 14.111 ) 

We set Iq = Jo{a) and li = [d;ln(n + 1)]. Then we can represent 7^(5') by 
the following way 

"fnis) = ±{1- mr el + -^ ± x\j) + A,„ 

with A-i „ = V"_, e^ . Note now that, for any < 5 < 1, 



h-1 



7, 



.(5) < {i+6)j2i^-m?o[ 



J=l-0 



AS) 



E ^(^■)^ 



where A2,„ = Y.]'=l 



"'t (^.n - 0,?- 



(A.7) 



25 



Due to the uniform convergence (14.91) . Lemmas 6.1 and 6.3 from ^ yield 

2 

lim sup n2'=/(2fc+i)y |^^j^o_ 

Now we set 

t;„(5)=n2'=/(2'=+i)sup(l-A(j))Vt^,, 
with the sequence zuj defined in (12.71) and 

v*{S) - 



— a\ 1 



TT 



where the coefficient A^ is defined in ( 13.61) . Moreover, one can calculate 
directly that 

lim sup sup ^< 1. (A.8) 

Therefore, due to the definition (12.71) and to the fact that 

7(^) = v*{S)r + ^(A,r(S))V(2'=+i)- ^^^ 



the inequality (TOl) and the limits (TOl) and (l4J0D imply (l4:TTD . D 

A. 3 Moment bounds 

Lemma A.l. Let ^^^^ 6e defined in (14.41) . T/ien, /or any real numbers 

Vi,...,Vn, 

(n \ 2 / „ \ 4 ^^2 

w/iere a^, = max^<^.<„ cr| and \^„ = Z]j=i ^j • 

The proof of this Lemma is similar to the proof of Lemma 6.4 in [9]. D 
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A. 4 Application of the van Trees inequality to diffu- 
sion processes. 

Let {C[0,T], B, {Bt)Q<t<T, (Pq ,0 e M^)) be a filtered statistical model with 
cylidric a-fields B^ on C[0,t] and B = Uq^^^j^B^. As to the distributions Pg 
we assume that it is distribution in C[0, T] of the stochastic process {yt)o<t<T 
governed by the stochastic differential equation 

dyt = S{yt, e)dt + dwt, 0<t<T, (A.9) 

where 9 = {9^, . . . ,9^)' is vector of unknown parameters, w = (wj)o<t<T i^ 
a standart Wiener process. Moreover, we assume also that S* is a linear 
function with respect to 9, i.e. 

d 

S{y,9) = J20,S,{y), (A.IO) 

i=l 

where the functions (5'.j)i<j<^ are bound and satisfy the Lipschitz condition, 
i.e. for some constant < L < oo 

I rr / \ I ^ r 1 K-'vll/J '-'7 1,'''] ^ t 

max sup |Oj(x)| < L and max sup j j < L. 



In this case (see, for example, [5j) stochastic equation (1A.9P has the unique 
strong solution {yt)o<t<T ^"^^ ^"^Y random variable 9 with values in M.'^. 

Moreover (see, for example [H]), for any 9 E M.'^ the distribution P^ is 
absalutly continuous with respect to the Wiener measure u^ in C[0,T] and 
the corresponding Radon-Nikodym derivative for any function x = (a;Jg<j<2- 
from C[0,T] is defined as 



"^^^ f{x,9) = expU S{xt,9)dxt-^f S\xt,9)dt\ . (A.ll^ 



^^w 
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Let $ be a prior density in W^ having the following form: 






d 



where y?,- is some continuously differentiable density in M. Moreover, let A(^) 
be a continously differentiable M'^ — > M function such that for each 1 < j < d 



where 



lim \{e)^Ae.) = Q and / |A' (^)| $(^) d^ < oo , (A.12) 



For any B{X) x i3(]R'^)— measurable integrable function ^ = ^(x, 9) we denote 

where A" = C[0,T]. 

Lemma A. 2. For any square integrable function Aj. measurable with respect 
to (^t)o<t<T '^^'^ /^^ ^^?/ ^ ^ J ^ d the following inequality holds 

A^ 

E(Ay-A(^))2> ^ ' 

where 






Aj= f X'.{9)^{9)d9 and Ij=f^^^dz. 

Proof. First of all note that for the function (lA.lOp and for the Wiener 
process w = (w^Jo<t<T density (1A.11I) is bounded with respect to 9j G M for 
any 1 < j < ci, i.e. 

lim sup f(w,9) < oo a.s. 
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Therefore taking into account condition flA.12p by integration by parts one 
gets 

E ((A^ - x{d))^,) = [ (x^x) - xm-^ {fix, erne)) d^z.4dx) 



x'^ie) f{x,eMe)de,]l[de,iy^{da 



Xxl 



^■- 



Now by the Bouniakovskii-Cauchy-Schwarz inequahty we obtain tha follow- 
ing lower bound for the quiadratic risk 



A^ 

E{XT-x{e)f> - ' 



E^] 



where 

d 






Note that from flA.lip it is easy to deduce that 



d [^ 

— \nf{y,e) = / Sj{yt)dwt. 

Therefore, due to the boundness of the functions 5"^- we find that for each 

E,^lnfiy,e)=0 and E, (^ J- ln/(y, ^) ^ = E, J S]{y,)dt. 

Taking this into account we can calculate now E\E^^, i.e. 

Evl/f = E /" S]iy,)dt + /,. . 

Hence Lemma [A. 2[ D 
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A. 5 Proof of ( 15341 ) 



We set 



'l'mM = h^lrM- 



Then by making use of definitions in flA.ip we can estimate the term <^^AT) 
as 



m,j) 



Moreover, taking into account that 



E 



Ms,M 



j.\-rm,]i 



(^All)%i.^r. 



hm sup|e.(/^) 



-11 =0 



we chose ?7 > for which 



infe^.(/p>l/2. 



Therefore we can write that 



y* V -t y* 

+ 7 ^5o(^-,.) - e,(^J)%(5™) . (A.13) 

We remind that on the set (15.71) for sufficiently large T the function Sgj. & T,j^ 
therefore we estimatethe first term in the right side of the last inequahty as 

2 



E (e^^^^ |A^(^„,^.)|) < ^P(S^) +SUP E^|A^(^^,^.) 
Moreover, taking into account that 



ST,, 



l^mjivMy 



e^.{v) I^^{v)dv <2 
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we obtain that 

limsup max max E (E^ |Ay(^ .)l ) < oo . 
To estimate the next term in flA.lSp we make use of the fact that on the set 



'E.rp the function Sq q. satisfies inequahty (15. 9p and one can check directly that 
on this set 

Therefore, with the help of this inequality we obtain that 

E |^s,,,(V'„,,) - ^5o(V'„,,)| < j e]{v)ll{v) E \qs^^^{i^ + vh) - q,{x^ + vh)\dv 

Finally it is easy to see that 



^5o(^m,i)-S-(^J)%(^'n) - / e^^(^)^J(^)l%(^m + ^^)-%(^m)|d^ 



<2 sup |go(n) -go(w)|, 

a<.u,v<.b ■\u—v\<h 

i.e. this term goes to zero as /i ^ uniformly over 1 < m < M and 
1 < J ^ N . Hence limit equality (15.141) 
D 
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